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ABSTRACT 



This report presents an analysis of the alignment between 
the grade level standards of the "South Dakota Standards in Mathematics" 
(December 1998) and test items from the Stanford Achievement Tests, Ninth 
Edition (Stanford 9) . The tests of interest were: (1) Form S, Primary 2 

(grade 2); (2) Form S, Intermediate 1 (grade 4); (3) Form S, Advanced 2 
(grade 8) ; and Form S, Task 3 (grade 11) . Two research analysts independently 
identified matches between the Stanford 9 test items for mathematics and the 
student knowledge and skills identified in the South Dakota standards. In 
every case, analysts, after discussion, were able to agree on the most 
appropriate matches for each test item. Once all test items were matched to 
the appropriate grade level standards, analysts were able to characterize how 
such grade level standards were assessed overall by the Stanford 9. Appendix 
A contains matches of test items with grade level standards . The test item 
matching is also presented in graph format in Appendix B. (Contains 35 
figures and 2 tables.) (SLD) 
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Purpose of Report 

This report presents an analysis of the alignment between the grade level standards of the South 
Dakota Standards in Mathematics (December 1998) and test items from the Stanford 
Achievement Tests, Ninth Edition, or Stanford 9, published by Harcourt Brace Educational 
Measurement (formerly the Psychological Corporation). The tests of interest were as follows: 

• Form S, Primary 2 (Grade 2) 

• Form S, Intermediate 1 (Grade 4) 

• Form S, Advanced 2 (Grade 8) 

• Form S, Task 3 (Grade 11) 

The purpose of this study is to describe for policy makers and other interested stakeholders how 
the mathematics standards are addressed by the Stanford 9. This study will 

• identify those grade level standards that are assessed in the Stanford 9 as well as 
those standards that are not assessed in the Stanford 9, 

• characterize the ways in which the Stanford 9 items test students on the 
knowledge and skills identified in the South Dakota Standards in Mathematics, 

• identify any Stanford 9 items that test students for knowledge and skills that have 
not been identified for those students in the South Dakota grade level standards, 
and 

• provide summary graphs to represent how test items from the Stanford 9 match 
the grade level standards. 



Method of Item Matching 

Two research analysts independently identified matches between the Stanford 9 test items for 
mathematics and the student knowledge and skills identified in the South Dakota Standards in 
Mathematics. When the two analysts completed their independent matches, they compared then- 
results and discussed any discrepancies. For the area of mathematics, it was found that in every 
case analysts were able to agree about the most appropriate matches for each test item. 

The analysts used two categories for identification during the matching process: direct and 
indirect. Direct matches indicate that a test item directly assesses the knowledge and/or skills 
identified in the grade level standards. For example, the Stanford 9 test item #34 in the Problem 
Solving section of the mathematics Primary 2 test requires students to compare objects and 
indicate which is shortest. This test item directly corresponds to the Kindergarten Measurement 
Standard 6, which states that the students "compare objects or events using direct comparison 
according to a given attribute. Example: length (longer/shorter), height (taller/shorter), volume 
(holds more/holds less)." Almost all of the matches in the mathematics section of the tests were 
found to be of this “direct” type. 
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Occasionally, a less obvious, or “indirect,” match was found to exist between a test item and a 
grade level standard. In such a case, the test item addressed content in the standard at some level, 
but there was not an exact match. For example, test item #4 in the Problem Solving section of 
the mathematics Primary 2 test requires students to identify which numeral is in the tens' place in 
a three-digit number. This item indirectly corresponds to the 2nd grade Number Sense Standard 
14, which states that the students "use words, models, and expanded notation to represent 
numbers with two or more digits." Although the test item does not require the student to 
represent place value, the student does need to understand place value concepts in order to 
answer the item correctly. Therefore, this match was identified as an “indirect” match. 

During the process of matching test items and standards, the research analysts first attempted to 
match the test items to standards that were at the same grade level as the test. If no match was 
possible, analysts then examined the standards for one grade below the grade level of the test. If 
there was still no match, the analysts examined the standards two grades below the level of the 
test. Finally, if there was still no match, the analysts examined the standards for one level above 
the grade level of the test . Table 1 illustrates the sequence analysts used in the matching process. 

Table 1 



Stanford 9 Test 


Grade Tested 


South Dakota 
Grades 
Analyzed for 
Matching (in 
sequence) 


Primary 2 


2 


2, 1, K, 3 


Intermediate 1 


4 


4, 3, 2, 5 


Advanced 2 


8 


8, 7, 6, 9-12 


Task 3 


11 


9-12 



If at the end of this sequenced search for a match, there was still no match found between a test 
item and a South Dakota grade level standard, a “miss” was declared. However, if in the 
determination of the analysts the item could not be matched to the standards because it addressed 
a rudimentary skill below the range of grades searched, the item was not counted as a miss. For 
example, test item #9 in the Problem-Solving section of the mathematics Advanced 8 test 
requires students to identify numbers as prime or composite. This skill appears under 3 rd grade 
Number Sense Standard 1, suggesting that it should have been mastered well before the test 
grade. It would be misleading, therefore, to count such a test item as a “miss” because there was 
no equivalent grade level standard within the search range. Such a test item was tagged as a 
“rudimentary skill.” 
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Descriptive Analysis 

Once all test items were matched to the appropriate grade level standards, analysts were able to 
characterize how such grade level standards were assessed overall by the Stanford 9. Analysts 
reviewed all the test items associated with a particular grade level standard and provided a 
summary narrative describing how students are asked to demonstrate their knowledge and skill. 
Finally, when test items appeared that were not addressed by the standards, analysts supplied not 
only a characterization of those items, but also selected one or more test items to represent the 
type of content that is assessed. 



Format for Reporting 

Matches of test items with grade level standards are presented in Appendix A. The test item 
matching is also presented in graph format in Appendix B. 

Appendix A: Report by Benchmark 

Appendix A first lists a summary of the South Dakota grade level standards that were of primary 
interest for the given test grade (that is, grades 2, 4, 8, and 11). For convenience, those grade 
level standards that were found to be assessed by test items in the Stanford 9 are marked with an 
asterisk. The following is excerpted from the summary of grade level standards for grade 2: 

Second Grade Number Sense Standards 

The student will: 

1 .* count by number groups to 1000 or higher, (example: 3s, 4s, 5s, 10s, 20s) 

2. associate verbal names, written word names, and standard numerals with whole numbers 
less than 1000. 

3. * identify ordinal positions using ordered sets of objects. 

4. * explain concept of even and odd numbers. 

5. explore the concept of mixed numbers. 

6. * solve two- and three-digit addition and subtraction problems. 

7. estimate sums and/or differences of two whole numbers and find the answers using the 
appropriate methods of computing. 

8. use models to explore addition and subtraction of fractions. 

9. identify the correct usage of decimal point for decimals and money. 

10. model problem situations in a variety of ways, (example: concrete materials, tables, 
charts, drawings, words) 

In this excerpt of the first ten grade level standards from the 2nd grade Number Sense standards, 
it can be seen that four grade level standards (1, 3, 4, and 6) have been matched to test items on 
the Stanford 9. 
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Following the summary of standards, two charts summarize the matches for that test. The first 
chart (Figure 1) summarizes test matching across the grades', the second (Figure 2) summarizes 
test matching across the standards. 



Figure 1 



Summary of Matches Across Grade Levels 

Mathematics Grade 2 Test: Stanford 9 
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Figure 2 




The detailed report of item matching follows the chart summaries. All grade level standards 
(within the range for analysis) that were found to match Stanford 9 items are listed. Beneath each 
of these grade level standards, the matched test item (or items) is identified by test name, subtest, 
and item number. Above this is a characterization of the item or items. This characterization is 
intended to provide the reader with a sense of how students are asked to demonstrate their 
knowledge and skill relative to the grade level standard. The following example is taken from 
this section. It identifies a standard on measurement at the 8th grade level: 

9. read, write, and explain exponential notation. 

Students must convert between scientific notation and standard form of numbers. 

Students must understand how to change exponential base to solve problems. 

Grade 8 (Advanced 2) 

Problem Solving 8, 10 
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In the example above, matches were made between the listed grade level standard and the 
Stanford 9 test for grade eight. In the Problem Solving subtest, item #8 was matched to the 
standard as well as item 10. In this example, the character of these items is described in two 
sentences just beneath the grade level standard. 

Finally, any items that were declared a “miss,” that is, could not be matched to a grade level 
standard, are characterized at the end of each appendix section. In addition to a list of the test 
items that could not be matched and a characterization of these items, a sample item from the test 
is provided. 

Appendix B: Matches in Chart Form 

Appendix B provides a graphical representation of the number of matches made between each 
Stanford test and the grade level standards. The frequency of matches of the test items to the 
grade level standards is represented by means of a bar graph. For example, Figure 3 shows the 
matches on the Stanford 9 test for grade 4 (Intermediate 1) and the grade level standards related 
to Geometry. The sample chart shows that there were no matches for the grade 2 level standards 
related to Geometry; however, at grade 3, standards two, four, and five each were matched to one 
test item. Fourth grade standards numbered two and three each had one direct match with a test 
item. In addition, another test item was matched indirectly to standard number three in the 4 th 
grade. Finally, one test item on the 4 th grade test was matched to a standard at grade 5. (See 
Method of Item Matching for an explanation of the process.) This summary of matches is 
provided for all standards - Algebra; Geometry; Measurement; Patterns, Relations, & Functions; 
Statistics & Probability - and for all tested grades. 
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Figure 3 



Geometry Standards 

Grade 4Test: Stanford 9 
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Summary of Results 

As a result of this analysis, we can make a number of observations relative to how the test items 
on the Stanford 9 address the South Dakota Standards in Mathematics. First, we address whether 
each test item can be matched to at least one grade level standard, in other words, whether the 
grade level standards address all the content found in the test. Next, we address whether any test 
items were matched to grade level standards above the grade level of the test. That is, do all 
students have adequate opportunity to learn the content for each test item before they are tested? 
Finally, we provide a summary table on the grade level standards that are not addressed by the 
achievement test. 

Can each test item be matched to a grade level standard? 

All of the test items in the grade 2 (Primary 2) and the grade 4 (Intermediate 1) tests were 
addressed by at least one grade level standard. In other words, all the knowledge and skill 
required to master each item on these two tests could be found described in the grade level 
standards. However, the grade 8 test had a total of five test items and the grade 1 1 test had a total 
of two test items that could not be matched to any mathematics grade level standard. This is a 
concern, for it suggests that students might not receive sufficient instruction to allow them to 
successfully answer items of this type. (These items are identified and described at the end of 
appendices A8 and All, which address tests for grades 8 and 1 1 respectively. Consult the Table 
of Contents that is provided for each Appendix.) 

Are there test items matched to grade level standards above the grade level of the test? 

As described in the opening section of this report, analysts first sought to match test items to the 
standards of the corresponding grade. For example, they first sought to match items at the 4 th 
grade test to the standards at grade four. If they failed to make a match, they next sought a match 
for one grade below, then two grades below. Before declaring a “miss,” analysts attempted to 
match the item contents to the grade above the test grade. Two matches were made above grade 
level for items on the 2nd grade test. Three matches were made above grade level for items an 
the 4 lh grade test. (No such problems appeared for the test grades 8 or 1 1). Wherever such a 
match was required should be of some concern, for it indicates that students are being tested on 
content for which, according to the grade level standards, they have not yet received instruction. 
(These items are identified and described in Appendices A2 and A4. Consult the Table of 
Contents that is provided for these appendices.) 



How many grade level standards are addressed by the Stanford 9? 

Each appendix, A 2 through All, provides a summary set of grade level standards, with a mark 
indicating those standards that are addressed by the Stanford 9. A count of these standards is 
provide in Table 2. 
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Table 2 



Stanford 9 Test 
(Total Number of 
Test Items) 


Total Standards at 
the Tested Grade 


Standards Matched 
to Test Items 


% of Standards 
Matched to Test 
Items 


Grade 2 (74) 


61 


19 


31.1 


Grade 4 (78) 


62 


15 


24.2 


Grade 8 (82) 


74 


16 


21.6 


Grade 11 (48) 


113 


15 


13.3 



Conclusion 

It should be noted that it is not the purpose of this study to evaluate the effectiveness of the 
Stanford 9 as an achievement test or as an assessment of the South Dakota standards. This is a 
descriptive report on the matches that were found to exist between items on selected Stanford 9 
tests and the South Dakota grade level standards in mathematics. We hope that this information 
will prove useful to policy makers and others who are engaged in the process of education 
reform. 
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